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Abstract 


Background 

Social and emotional learning (SEL) programs have been shown to increase aehievement test scores in 
reading and math by 1 1 pereentile points; improve social and emotional skills by 23 pereentile points; 
improve attitudes about self, others, and school by 9 percentile points; improve pro-social school and 
classroom behavior by 9 pereentile points; decrease conduet problems by 9 pereentile points; and 
deerease emotional distress by 10 percentile points (Durlak, Weissberg, Dymnicki, Taylor & 
Sehellinger, 2011). This study involves a rigorous process and impaet evaluation to learn about 
district-level SEL implementation for Kindergarten through Grade 5 in a large urban district using the 
evidenee-based SEL program Open Circle. 

Research on SEL has largely focused on elassroom interventions and student- and classroom-level 
outcomes. Lew studies have examined whole-sehool and distriet-level SEL implementations, or how to 
ensure that SEL programs are implemented effeetively and sustained over time. 

Objective 

This study examines both proeess outeomes and program impact as Open Circle is rolled out across a 
large, urban district over a three year period beginning in June 2012. It includes a large sample of over 
7,000 students, 400 elassrooms and 23 schools, and is measuring program implementation, sehool 
climate, and soeial and emotional development at the student, classroom, school, and district levels. The 
study investigates the following researeh questions: 

• What are the eritical faetors to suceessful implementation of a whole-school, comprehensive 
SEL program as it is scaled up aeross one third of elementary schools serving grades K-5 in a 
large urban sehool district over a three year period? 

• How will the implementation of the Open Circle Curriculum and corresponding professional 
development influence school climate, teacher practiee, and students’ social and emotional skill 
development, and behavior? 

Intervention Program 

Open Cirele is an SEL program for Kindergarten through Grade 5. The grade-differentiated Open 
Circle Curriculum proactively develops children’s skills for reeognizing and managing emotions, soeial 
awareness, positive relationships and problem solving. It also helps schools build a community where 
students feel safe, eared for and engaged in learning. See Table 1 for a list of Open Cirele’s SEL skills 
and practices. 

Open Cirele involves a comprehensive whole-sehool approaeh in whieh all adults in a school’s 
community - teachers, administrators, counselors, support staff and families - learn to model and 
reinforce pro-social skills throughout the school day and at home (see Eigure 1). Classroom teachers 
implement the Open Circle Curriculum during twiee-weekly, 15-minute Open Circle Meetings. 

Students form a eirele of ehairs, including an empty seat to symbolize that there is always room for 
another person, voice or opinion. Open Circle lessons are highly interactive, incorporating large and 
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small group discussions, role playing, community-building activities, and high quality children's literature. 
Families are engaged through Open Circle workshops and letters introducing the Open Circle 
Curriculum and key vocabulary (available in eight languages). Schools sustain and improve Open 
Circle practice over time by developing Open Circle peer coaches and leadership teams. Open Circle’s 
professional development for teachers is spaced across the school year to align with best practices in 
adult learning (multiple cycles of experiential learning, practice, and reflection). See Table 3 for a list of 
Open Circle teacher development practices. 

Setting 

The participating large, urban school district faces challenges shared by many districts of similar scale 
and socioeconomic profde: high rates of suspensions (8.5%), high rates of repeating grades (7.4%), and 
dropout (8.9%), coupled with low scores on standardized reading and mathematics assessments and 
low graduation rates (57.9%). Nearly three fourths of students are characterized as low-income, about 
one fifth have limited English proficiency, and a slightly higher percentage receive special education 
services. The district serves over 28,000 K-5 students (36% Black, 40% Hispanic, 13% White, 9% 

Asian, 2% Other/Multi-Racial). Since the project began in June 2012, the district has undergone 
significant transitions, including; a new city mayor, (interim) superintendent, network model for school 
oversight, teacher evaluation system, teacher hiring process, and Common Core curriculum. Among the 
23 participating schools, nine had principal changes during or between Years 1 and 2. Research 
partners include researchers at the Wellesley Centers for Women, Open Circle, the Violence Prevention 
Department of the city’s public health commission, and the implementing district and schools. There has 
also been significant turnover among partner contacts: the lead contact at the city’s public health 
commission changed twice due to maternity leaves and the lead contact at the district changed three 
times due to reorganizations. 

Recruitment 

Participating schools received free schoolwide training and curriculum through a grant to the city’s public 
health commission from a local healthcare organization. At the outset of the project in the spring of 
2012, the district included 73 schools serving students in Kindergarten through Grade 5. Of those, ten 
were ineligible to participate because they were already using Open Circle. More than half (34) of the 
remaining 63 eligible schools expressed interest in the project. Interested schools were prioritized based 
on location with and/or student population of predominantly low-income families. Selection of an initial 
cohort of 19 schools was conducted by the district’s superintendent for elementary education with input 
from the superintendent for K-8 schools as well as other project partners (including representatives 
from the city health commission, the project funder, and Open Circle). Three of these 19 schools did 
not continue in the second year due to principal disengagement/retirement or competing demands from 
other initiatives. Seven schools joined in the second year (with similar criteria and selection process), 
bringing the total number of participating schools to 23. 

Participants . A total of 793 staff (413 teachers; 332 counselors, specialists, paraprofessionals; 48 
administrators) received professional development directly impacting 7,434 students. 


SREE Fall 2014 Conference Abstract 


B-3 



Research Design 


This study includes primary data from the first two years gathered through elassroom observation and 
student surveys in grades 3 and 5, Open Cirele fidelity ehecklists completed by coaehes and observers, 
semi-annual online surveys completed by teachers, administrators and sehool support staff, and foeus 
group and individual interviews with staff. Data also ineludes training attendance and eoaehing logs. 
Future studies will inelude student and school climate data collected by the district for all schools serving 
grades K-5, enabling matched comparison grouping. 

Measures. Open Cirele fidelity checklists were recorded by eoaehes for 162 teaehers in Year 1 and 
182 teachers in Year 2. Observations using the Classroom Assessment Scoring System (CLASS; 

LaParo, Pianta, & Stuhlman, 2004) were conducted in the fall (pretest) and spring (posttest) eaeh year 
at 12 schools. We targeted recruitment at all schools, however, teaehers were not required to 
participate, thus deereasing our compliance rate. Within eaeh sehool, one grade 3 and one grade 5 
elassroom was ehosen at random for observation. In observed classrooms, 43 1 students eompleted 
four subscales of the Soeial Skills Improvement System (SSIS; Elliott, Gresham, Frank, & Beddow, 
2008), including: Cooperation, Empathy, Self-Control, and Bullying. 

Annual pre- and posttest online survey respondents included 324 teaehers, administrators and school 
support staff. Surveys recorded school, role, years of experienee, perceived impact of Open Cirele 
training and eoaehing, self-rated Open Cirele implementation fidelity, pereeived impact of Open Circle 
programming, perceptions of school climate, and observations of students’ demonstration of pro-soeial 
skills and negative behaviors. One focus group and additional individual teacher interviews (total 
partieipant n=15) were also eondueted in the years 1 and 2 of implementation. 

Analyses. Descriptive and inferential statisties were conducted using SAS. Open-ended survey and 
transcribed foeus group and individual interview data was analyzed for evidence of the proeesses 
underlying the statistieal assoeiations. Analyses of posttest CLASS observations and student surveys 
over time will be included in the fall conference presentation. 

Implementation 

Of the 23 participating schools, 78% trained alEnearly all teaehers, 17% trained a majority and only 4% 
trained less than half. Training participation for specialists and paraprofessionals was slightly lower: 43% 
trained all/nearly all, 39% trained a majority, and 17% trained less than half. Every school trained at 
least one administrator and all behavioral health staff. Overall, 74% of schools achieved high training 
engagement (training most school staff), 22% demonstrated mixed engagement, and 4% had low 
engagement. Among trained teachers, 89% attended all four training sessions, 7% attended three 
training sessions and 4% attended only the first two training sessions. A majority (79%) participated in 
two eoaehing visits, 18% participated in one and 3% partieipated in zero. The most common reasons 
for ineomplete training and eoaehing were: teaeher left sehool or changed role (i.e. no longer a 
grade-level teaeher) and scheduling challenges to aceommodate training sessions and coaching visits 
during the sehool year. 
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Coaches rated 63% of teaehers as skilled implementers and an additional 30% as somewhat skilled. 
Most teaehers reported implementing the Open Circle Curriculum two or more times (56%) or onee 
(25%) per week. Nearly half of teaehers (46%) reported eompleting all or nearly all of the Open Circle 
Curriculum lessons, while 37% eompleted approximately three-quarters, 10% eompleted half, and 7% 
eompleted less than half. A majority of teaehers reported frequently or very frequently infusing Open 
Cirele by: integrating Open Cirele skills, voeabulary and eoneepts throughout the day (75%); modeling 
Open Cirele skills and voeabulary throughout the day (69%); and posting visuals refleeting Open Cirele 
eoneepts (60%). Nearly all teaehers agreed that their prineipal (94%) and eolleagues (95%) supported 
their use of Open Cirele. 

A majority of trained speeialists and paraprofessionals reported frequently or very frequently infusing 
Open Cirele in their work by using Open Cirele voeabulary in interaetions with students (61%) and 
eneouraging students to praetiee Open Cirele skills (59%). Many also reported oeeasionally to very 
frequently using Open Cirele eommunity-building aetivities (70%), posting Open Cirele visuals (55%), 
and using Open Cirele approaehes and voeabulary in sehool-wide aetivities sueh as assemblies (66%). 
Among prineipals, 100% agreed that SEL was an integral part of their schools’ programming. 

Outcomes 

Results from staff surveys showed strong endorsement of Open Cirele by almost 90% of staff: 47% 
“agreed” and 40% “strongly agreed” they would reeommend Open Cirele to a eolleague. On average, 
staff at post-test reported positive outcomes of implementation direetly related to their observed 
students’ soeial and emotional outeomes. 

Observations showed positive eorrelations between teaehers’ fidelity of implementation of Open Cirele 
and quality of teaeher-student interaetions in the CLASS domains of Emotional Support and Classroom 
Organization and with student engagement, attention, and respeetful behavior in the elassroom. 

Analysis of interview data suggests ways that Open Cirele has an impaet on student SEL outeomes. The 
most eommon sueeesses named were the various ways in whieh students individually and as a elass 
learned to “ealm down,” whieh was deseribed by one participant as the first step in problem-solving. 
One teaeher reported that the inereased speed of her students’ quieting down and transitioning in her 
elass probably gained her about 15 minutes of aeademie learning time eaeh period. 

Conclusions 

Preliminary results indieate that this whole-sehool SEL program is highly sealable, reaehing over 7,000 
students with training for nearly 800 staff members at 23 distriet sehools in a two-year period. Teaehers, 
students and administrators are responding favorably to the program and the format of twiee-weekly, 
15-minute elassroom meetings appears highly feasible. Key sueeess faetors have been robust 
whole-sehool professional development, high quality implementation, initial and ongoing prineipal and 
distriet administrator support and teaeher buy-in. Teaehers also need ongoing support from 
administrators and peers. Eortheoming data will enable further eonelusions about outeomes and impaet. 
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Appendix B, Tables and Figures 


Listening 

Being Calm 

Positive Self-Talk 

Building Positive Relationships 

Giving & Receiving Compliments 

Cooperating 

Speaking Up 

Expressing Anger Appropriately 
Responding to Annoying Behavior 
Understanding Tattling vs Telling 
Responding to Teasing 
Addressing Dangerous & Destructive 
Behavior 

Recognizing Bullying Behavior 
Being a Responsible Bystander 
Recognizing Discrimination 


Understanding Feelings 
Reading Body Language 
Developing Empathy 
Problem Solving 
Setting Positive Goals 
Brainstorming & Creative Thinking 
Reaching Consensus 
Evaluating Solutions 
Overcoming Obstacles 
Eeadership 
Classroom Meetings 
Getting to Know Each Other 
Establishing Classroom Rules 
Understanding Non-Negotiable Rules 
Community-Building Exercises 
Encouraging Student Voice 


Table 1: Open Circle’s SEL Skills and Practices 


Figure 2: Wbole-Scbool Approach 
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Table 3: Open Circle’s Teacher Development Practices 


• Wait/Think Time 

• Reflection 

• Lesson Pacing 

• Managing Self 

• Tone of Voice 

• Modeling 

• Body Language 

• Dialog Facilitation 

• Empathic Listening 

• Coaching the Problem Solving Process 

• Turn and Talk 

• Group Theory & Development 

• Whole Group Responses 

• Infusing SEL Throughout the School D; 

• Non- Judgemental Responses 



SREE Fall 2014 Conference Abstract 


B-8 






